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Abstract 

Branching Processes in Random Environment (BPREs) [Zn : n > 0) are the generahzation 
of Galton- Watson processes where in each generation the reproduction law is picked randomly 
in an i.i.d. manner. In the supercritical regime, the process survives with a positive probability 
and grows exponentially on the non-extinction event. We focus on rare events when the process 
takes positive values but lower than expected. 

More precisely, we are interested in the lower large deviations of Z, which means the asymptotic 
behavior of the probability {1 < Z„ < exp(nS)} as n — > oo. We provide an expression of the 
rate of decrease of this probability, under some moment assumptions, which yields the rate 
function. This result generalizes the lower large deviation theorem of Bansaye and Berestycki 
I I (2009) by considering processes where f{Zi = 0\Zo = 1) > and also much weaker moment 

, assumptions. 

^ AMS 2000 Subject Classification. 60J80, 60K37, 60J05, 60F17, 92D25 

Key words and phrases, supercritical branching processes in random environment, large deviations, 
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CN 1 Introduction 

^ Branching processes in random environment (BPREs), which have been introduced in [261 [2], 

are a discrete time and discrete size model in population dynamics. The model describes the 



development of a population of individuals which are exposed to a (random) environment. The 
environment influences the reproductive success of each individual in a generation. More formally, 
we can describe a BPRE as a two-stage experiment: 

In each generation, an offspring distribution is picked at random and, given all offspring distribu- 
tions (the environment), all individuals reproduce independently. 



Special properties of the model like the problems of rare events and large deviations have been 
studied recently [551 [71 [TUl [Ml [HI [IH] ■ In the Galton Watson case, large deviations problems are 
studied from a long time [HIS] and fine results have been obtained, see [T^ [T51 [5^ [55] . 
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Let us now define the branching process Z in random environment. For this, let A be the space of 
aU probabihty measures on No = {0, 1,2,.. .} (the set of possible offspring distributions) and let Q 
be a random variable taking values in A. By 



k>0 

we denote the mean number of offsprings of q G A. Throughout the paper, we will shorten q{{-}) 
to q{-). An infinite sequence £ — (Qi, Q21 . . •) of independent, identically distributed (i.i.d.) copies 
of Q is called a random environment. 

The process (Z„ : n > 0) with values in Nq is called a branching process in the random environment 
E if Zq is independent of E and it satisfies 

£(Z„ I Zo,...,Z„_i) = Q,f"-i a.s. (1.1) 

for every n > 0, where g*^ is the z-fold convolution of the measure q. 

As it turns out, probability generating functions (p.g.f.) are an important tool in the analysis of 
BPRE. Thus let 

00 

/„(s) :=^s^-g„(fc), (5 6 [0,1]) 

fc=0 

be the probability generating function of the (random) offspring distribution Qn- Throughout the 
paper, we denote the conditioning on Q„ indifferently by E[-|Q„] and E[-|/„]. Also for the associated 



random environment we write both E — (/i,/2,---) and E — iQi,Q2, ■■■)■ In this notation, (1.1) 
can be written as 

E[s^"|f, Zo,...,Z„_i] -/„(s)^-i a.s. (0<s<l). 

Another important tool in the analysis of BPRE is the random walk associated with the 
environment (5„ : n E Nq). It determines many important properties, e.g. the asymptotics of 
the survival probability. (5„ : n e No) is defined by 

where 

Xn logTOQ^ = l0g/,'i(l) 

are i.i.d. copies of the logarithm of the mean number of offsprings X := log(mQ) = log(/'(l)). 
The branching property then immediately yields 

E[Z„|Qi,...,g„,Zo = 1] = e^" a.s. (1.2) 

The characterization of BPRE going back to |2i is classical: 

In the subcritical case (E[A'] < 0), the population becomes extinct a.s. at an exponential rate. 
The same result is true in the critical case (E[Ar] = 0) (excluding the degenerated case when 
Pi(Zi = 1) = 1), but the rate of decrease of the survival probability is no longer exponential. 
If Ei[X] > 0, the process survives with positive probability under quite general assumptions on 
the offspring distributions (see |5S]) and is called supercritical. Then E[Zi log'^(Zi)//'(l)] < oo 
ensures that the martingale e~^"Zn has a positive finite limit on the non-extinction event: 

lim e-^"Zn = W, V{W > 0) = P(Vn e N : Z„ > 0) > 0. 



2 



The large deviations are related to the speed of convergence of exp(— 5„)Z„ to W and the tail of 
W. This latter is directly linked to the existence of moments and harmonic moments of W. In 
the Galton Watson case, we refer to [1] and [35] • For BPRE, Hambly [T7] gives the tail of W in 0, 
whereas Huang & Liu [T51 [12] obtain other various results in this direction. 

We prove here an expression of the lower rate function for the large deviations of the BPRE, i.e. 
we specify the exponential rate of decrease of P(l < Zn < e^") for < < E[X]. In the Galton 
Watson case, lower large deviations have been finely studied and the asymptotic probabilities are 
well-known, see e.g. [TH [TSl [23] . In the case of a random environment, the rate function has been 
established in [7] when any individual leaves at least one offspring, i.e. F{Zi = 0) = 0. This result 
is extended here to the situation where V{Zi = 0) > and the moment assumptions are relaxed. 
We add that for the problem of upper large deviations, the rate function has been established 
in [101 |S] and finer asymptotic results in the case of geometric offspring distributions can be 
found in [22l [23]. Thus large deviations for BPRE become well understood, even if much work 
remains to get finer asymptotic results, deal with weaker assumptions or consider the Bottcher 
case (P(Zi > 2) = 1). 

2 Preliminaries 

We are working in the whole paper under the following assumption. 
Assumption 1. There exists an s > such that E[e^*"^] < oo. 

This assumption ensures that a proper rate function A of the random walk {Sn : n £ N) 

A{0) := sup{A6l-log(E[exp(AX)])} (2.1) 

exists. We note that the supremum is taken over A < and not over all A G M. As we are only 
interested in lower deviations here, this definition is more convenient as it implies A{9) — for 
all 6 > E[X]. We briefly recall some well-known facts about the rate function A which are useful 
here (see [11] for a classical reference on the matter). Define 4>{X) — logE[exp(AAr)], I?^ — {A : 
0(A) < oo} and let be the interior of the set V^. Then the map x i— ?> A(x) is strictly convex 
and infinitely often differentiable in the interior of the set {6* G M : 6* = <j)'{X) for some A G 2?^}. 
Let 9 — (t)'{Xe) for some Xg G V^. It then also holds that 

A'(0) = Xe . 

Moreover for every 9 < E(X) 

hm -ilogP(5„<fc)-A(0). (2.2) 

n— >-oo 

To state the results, we will use the probability of staying positive but bounded which is treated 
in [H]. Let us define 

I :={]>! : P(Q(j) >0,Q(0) >0) >0} 
and introduce the set Cl{{z}) of integers that can be reached from z G X, i.e. 

Cl{{z}) := {k>l:3n>0 with ¥,{Zn ^k)>0}. 
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In the same way, we introduce the set Cl{X) of integers which can be reached from X by the process 
Z. More precisely, 

Cl{I) {fc > 1 : 3n > and j e I with Pj(Z„ = fc) > O}. 
In the following, we will denote 

P(-|Zo = z)-P,(-) 

and write P(-) when the initial population size is not relevant or can be taken equal to one. 
From [5], we have 

Proposition 2.1. (i) IfPi{Zi = 0) = and Pi(Zi = 1) > 0, then for all k and j G Cl{{k}), 

lim i logPfc(Z„ =j)=k Pi(Zi = 1). 

71— >-00 

(a) IfE[X] > and P(Zi = 0) > 0, then we define 

I:={j>l : P(Q(i) > 0, Q(0) > 0) > 0} 
and the following limits exist, coincide for all k,j G C'l{T) and belong to [0,oo), 

g:^ lim ilogPfc(Z„ = 

In [5], some general conditions are stated which assure g > and g < A(0). It also gives a (non 
explicit) expression of g in terms of the successive differentiation of the p.g.f fi- 
In the Galton Watson case, / is constant, for every i > 0, fi = f a.s. Then, we recover the classical 
result [1] 

g^ -\ogf'{pe), Pe := inf{s G [0,1] : f{s) = s}. 

Moreover, in the linear fractional case we have an explicit expression of g. We recall that a 
probability generating function of a random variable R is linear fractional (LF) if there exist 
positive real numbers m and b such that 

+ 6to^2(1 — s)/2 ' 

where m — /'(I) and b ~ /"(!)• Then, wc know from [S] that under some conditions, which will 
be stated in the next section, 

r -logE[e-^] , ifE[Xe-^]>0 
^ \ A(0) , else 

3 Lower large deviations 

We introduce the following new rate function defined for 0, x > and any nonnegative function H 

x{0,x,H) = M {tx+{l-t)H{0/il-t))}, 
te[o,i] 

with the convention • oo = 0. 
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3.1 Main results 

To state the large deviation principle, we recall the definition of g and A from the previous section 
and we need the following moment assumption: 



Assumption 2. For every A > 0, 

E 



r(i) 

1 - /(o) 



< CX). 



We also denote fc„ — > oo when fc„ — ^ oo but A:„/ exp(0n) for every > 0, as n — ^ oo. 

Theorem 3.1. Under Assumptions^ &^ and E[Zi log^(Zi)] < og, the following assertions hold 
for every 9 E {0,E[X]]. 

(i) IfVi{Zi = 0) > 0, then for every i € Cl{I) 

hm i logP,(l < Z„ < e^") = -x{e, A). 

n— ^oo 

Moreover, kn — > oo ensures that lim„_j.oo ^logPi(l < Zn < fc„) = —g. 

(ii) IfPi{Zi = 0) = 0, then for every i > 1, 

lim ilogP,(l < Z„ < e'^) - -x(0,-ilogE[Q(l)],A). 

n—>oo 

Moreover, kn — > oo ensures that lim„^oo ^logPi(l < Zn < fc„) = i logE[(5(l)]. 

First, we note that (ii) generalizes Theorem 1 in |7], which required that both the mean and 
the variance of the reproduction laws were bounded (uniformly with respect to the environment). 
Moreover, (i) provides an expression of the rate function in the more challenging case which allows 
extinction (Pi(Zi = 0) > 0). 

We now try to extend this result and get rid of Assumption [2j before discussing its interpretation 
and applying it to the linear fractional case. So we now consider 

Assumption 3. We assume that S is non-lattice, i.e. for every r > 0, V{X G J'Z) < 1. Moreover, 
we assume that there exists a constant < d < oo such that, 

Mq < d ■ [mg + (mg)^] a.s., 

where Mq =^ X!fc>o k'^lik) is the second moment of the probability measure q. 
This condition is equivalent to the fact that /"(l)/(/'(l) + /'(l)^) is bounded a.s. 

This assumption does not require that E[/'(l)'''] < oo for every A > 0, contrarily to Assumption 
[2j But it implies that the standardized second moment of the offspring distributions is a.s. finite. 
It is e.g. fulfilled for geometric offspring distributions (see [TO]). We focus here on the case when 
subcritical environments may occur with positive probability. 

and ¥{X < 0) > 0, for any scquctlcg kn ■ cxd and 

i G Cl{T), we have 

lim }^\ogV,{l<Zn<kn) = -g. 
Under the additional Assumption^^ and E[Zi log^(Zi)] < oo, for every 6 £ (O, IE[-^]] , 

lim sup i logP,(l < Zn < e''") = -x{d, A). 
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The proof of the upper-bound of this resuh is very different from that of the previous theorem. It 
is deferred to Section [43) Let us now comment the large deviations resuhs obtained by the two 
previous theorems. 




Figure 1: % and A in the case 9* > 0. 

We note that A (and thus x) is a convex function which is continuous from below and thus has 
at most one discontinuity, li g < A(0), there is a phase transition of second order (i.e. there is a 
discontinuity of the second derivative of x)- In particular, it occurs if A(0) > — logE[(5(l)] since 
we know from 0] that g < — \ogE[Q{l)]. In contrast to the upper deviations (TUIIH], there is no 
general description of this phase transition. It seems to heavily depend on the fine structure of the 
offspring distributions. In the linear fractional case, we are able to describe the phase transition 



more in detail (see forthcoming Corollary 3.3 1 



We also mention the following representation of the rate function, whose proof follows exactly 
Lemma 4 in |8, and is left to the reader. We let < 6* < E[X] be such that 

g"A(r) ^ .^^ g - Aje) 
6* o<0<Eix] 6 

Then, 



x{0,g,K) = 



p(i-^) + ^A(r) e< 
A{0) e > 



We recall that g is known in the LF case from Theorem 2.3, and we derive the following result, 
which is proved in Section [4. 5[ 
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Corollary 3.3. We assume that f is a. s. linear fractional. Under Assumptions^&^or Assump- 
tions^ &^ we have for all 9 G (0, E(X)] and j > 1, 

lim i log (1 < Z„ < e'") = x{0, Q, A) - min { - - log E [e"^] , A(0) } . 

More explicitly, 6* = E[X exp(-X)] /E[exp(-X)]. 

Ife<e*, then x{e,g,A) = -9 - log E [e-^] , otherwise x{d, Q, A) = K{9) . 

We note that if the offspring-distributions are geometric, Assumption [3] is automatically fulfilled 
(see [in]). Moreover, except for the degenerated case P(Zi = 0) = 1, we have P(Zi = 1) > in the 
linear fractional case. Note that the non-lattice assumption made in Assumption [3] can be dropped 
since one can directly proved in the LF case that g < A(0). 

3.2 Interpretation 
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Figure 2: Most probable path for the event {1 < Z„ < e''"} with <9 <9*. 

Let us explain the rate function x and describe the large deviation event {1 < Z„ < e^"} for some 
< 9 < E[X] and n large. This corresponds to observing a population in generation n which is 
much smaller than expected, but still alive. A possible path that led to this event looks as follows 
(see Figure [2| . 

During a first period, until generation [tn\ {0 < t < 1), the population stays small but alive, 
despite the fact that the process is supercritical. The probability of such an event is exponentially 
small and of order eKp{—g[nt\ +o{n)). Later, the population grows in a supercritical environment 
but less favorable than the typical one, i.e. — S^nt^ < 9n}. This atypical environment sequence 
has also exponentially small probability, of order exp(— A((?/ (1 — <)) [n(l — t)J +o{n)). The probabil- 
ity of the large deviation event then results from maximizing the product of these two probabilities. 

More precisely we may follow ^ to check that the infimum of x is reached at a unique point tg 
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by convexity arguments. Thus 



x{e)^UQ + {i-te)K{e/{\-tg)), 



te e [o,i-e/E[x]] 



and we can define the function fg : [0,1] i-^ M_|_ for each 9 < E[X] as follows 



fe{t) : 



0, 



e 

l-te 



{t-te), 



lit <tQ 

at > tg. 



Then, conditionally on {1 < Zn < exp{n6)}, the process (log(2'[t„])/n : t e [0,1]) converges in 
finite dimensional distributions to the function (feit) : t E [0, 1]). 

From the point of view of theoretical ecology, these results shed light on the environmental and 
demographical stochasticity of the model. More precisely, randomness in a BPRE comes both from 
the random evolution of the environment (environmental stochasticity) and the random reproduc- 
tion of each individual (demographical stochasticity). Thus a rare event {1 < < exp(n0)} for 
n large and 9 < E[X] may be due to a rare sequence of environments (less favorable than usual 
since Z„ < exp(n0), but not bad enough to provoke extinction) and/or to unsual reproductions of 
individuals. Our results show that it is a non-trivial combination of both. 

In a first period [0, tg], the population just survives thanks to a combination of environmental and 
demographical stochasticity (we call this period survival period). If P{Zi 0) = 0, we know that 
the population remains constant. Thus the typical environment / is biased by Pi(Zi = 1|/) = /'(O) 
and the number of offspring is forced to be 1 for (almost) all individuals. If ¥{Zi = 0) > and 
g < A(0), e.g. in the LF case, again it is a combination of the demographical and environmental 
stochasticity. If ¥{Zi = 0) > and g = A(0), the time of the survival period is reduced to : 
te = 0. 

In a second period [tg, 1], the population grows exponentially but at a lesser rate than usual. This 
is only due to the environmental stochasticity : the typical environment / is not biased by the 
mean offspring number /'(I). 

3.3 Application to Kimmel's model : cell division with parasite infection 

As an illustration and a motivation we deal with the following branching model for cell division 
with parasite infection. It is described and studied in In each generation, the cells give birth 

to two daughter cells and the cell population is the binary tree. The model takes into account 
unequal sharing of parasites in the two daughter cells, following experiments made in Tamara's 
Laboratory in Hopital Necker (Paris). 

More explicitly, we assume that the parasites reproduce following a Galton- Watson process with 
reproduction law {pk : k > 0). We consider a random variable P G (0, 1) a.s. and, for convenience, 
we assume that its distribution is symmetric with respect to 1/2 : P = 1 — P. This random 
parameter gives the binomial repartition of the parasites in each daughter cell. It is picked in an 
i.i.d manner for each cell. Thus, conditionally on the fact that the cells contain k parasites when 
it divides and conditionally on this parameter being equal to p, the number of parasites inherited 
by the first daughter cell follows a binomial distribution with parameters {k,p), whereas the other 
parasites go in the other daughter cell. In other words, each parasite is picked independently into 
the first daughter cell with probability p. 
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The number of cells in generation n is 2". Then, a simple computation proves that the number of 
cells Nn[a, b] in generation n whose number of parasites is between a and b satisfies 

E[Nn[a,b]] ^T¥(Zn € [a,b]), 

where is a BPRE whose environment is given by the random variable (r.v.) P : 

oo 
k>i 

As a consequence of the previous Theorems, we can derive the mean behavior of the number of 
cells infected by a positive number of parasites which is smaller than usual: 

-logE[iV„[l,exp(n0)]] - log(2) - x(^, A) 9 <E{X), 
n 

where A is the Fenchel Legendre transform of the r.v. 

X:=log(^fcpfe)+log(P). 

k>0 

In particular, let us assume that {pk)k>o is a linear fractional offspring distribution, i.e. there exist 
a G [0, 1] and q £ [0, 1) such that 

P0 = a, Pk = {l-a){l-q)q''{k>l). 

Then 

OO 

F,{Z,=t\P = p) = ^agV(l -P)'-' = , , {qpY, 

^ i-Ci-p)? 

i.e. the offspring distribution for the branching process Z is also a.s. linear fractional. Thus we can 
apply Corollary |3.3| and g can be calculated explicitly from the distribution of P. Furthermore, 
solving x{S, g, A) > log 2 yields the set of 9 such that we observe cells infected by a positive number 
but less than exp{n9) parasites (for large times). 



4 Proof of lower large deviations 

First, we focus on the lower bound, which is easier and can be made under general assumptions 



(satisfied in both Theorems |3 . 1 1 and 3.2 ). We split then the proof of the upper bounds in two parts, 
working with Assumption [2] in the first one, and then with P(A < 0) > and Assumption [3] in the 
second. Finally, we prove the theorems combining these results. 



4.1 Proof of the lower bound for Theorems 13.11 and 13.21 

First we note that, if the associated random walk has exceptional values, the same is true for 
the branching process Z. The estimation Z„ ss K[Zn \£] ~ exp(S'„) a.s. gives a lower bound 
in the following way. If E[Zilog+(Zi)] < oo, wc know fr om 2J that the limit of the martingale 
Z„exp(— is non-degenerated. Then a direct generalization of [7, Proposition 1] ensures that 

lim inf i log P, (1 < Z„ < e^" |5„ < {9 + e)n) = 0, 
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for all j > 1 and e > 0. It relies on the same change of measure as in the proof of ^ Proposition 
1]: 

E[m{Qy 

where Ac is the argmax of A —> Ac — <p(A): 



nQ e dq) ^r^A^A e dp), 



sup{Ac - ip{X)} = XcC - (p{Xc)- 
\<o 

As A is non-increasing, continuous from below and convex and thus a right-continuous function, 
A{9 + e) ^ A{0) as e -J> 0. Then, for every < 9 < E[X] such that A{9) < oo, we have 

liminf i logP,(l < Z„ < e'^"|S'„ < 9n) = 0. (4.1) 

Now we can prove the following result 

Lemma 4.1. Let z > 1. We assume that E[Zi log^(Zi)] < oo and that 

Q, = - lim ilogP^(l < Z„ < 6) 

n— ^cxD 

exists and does not depend on h large enough. Then for every 6 G (0,E[X]], we have 

hminf ilogP,(l < Z„ < e'^") > -x(0,g„A). 

Proof. We decompose the probability following a time t e [0, 1) when the process goes beyond h. 
Using the large deviations principle satisfied by the random walk S, we have 

P.(l < < e'") 

> P.(l < ^LtnJ < ^ ^L(i-t)"J < e'"; ^L(i-t)"J < e'") 

^ ID) n ^ 7 ''^(t^)"(i-*)+°(") • ro a / v / T^»(i-*) e ^ t^«(i-*)A 

> P4I < Z^inj < t))e V / ^mm^Pfc(^l < ZL(i_t)„j < ei-« '5^„<ei-« "j . 



Note that the above inequality is trivially fulfilled if A.{9) = 00. The definition of gz and (4.1 ) yield 
with b large enough 

liminfilogP,(l<Z„<e«")>- inf {tp, + {I - t)A{9/{l - t))}. 

ri-i-oo te[0,l) 

Adding that Pz{l < Zn < e^") > P2(l < < ^) for n large enough, we can take the latter infimum 
of [0, 1], again with the convention • 00. It yields the expected lower bound — x(^, Qz, A). □ 



4.2 Proof of the upper bound for Theorem 3.1 (i) and (ii) 



The next lemma ensures that a large population typically grows as its expectation and thus follows 
the random walk of the environment S. The start of the proof of this proposition is in the same vein 
as [7j, but the situation is much more involved since Pi(Zi = 0) may be positive, /'(I) may not be 
bounded a.s. and the variance of the reproduction laws may be infinite with positive probability. 

Lemma 4.2. Under Assumption^ for every e > and for every a > 0, there exist constants 
c,b > 1 such that for every 71 G N 

snpPz{Z„ < e^"^"";Zi > b,...,Z„ > b) < c e""". 

z>b 
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Proof. Let us introduce the ratio of the successive sizes of the population 



Ri := Zi/Zi_i, ie{l,...,n}. 
Recalling that log //(I) = Xi, we can rewrite 



Then for every A > 0, we can use the classical Markov inequality ¥(Y > 1) < E[Y''^] for any 
nonnegative random variable Y and get for every z > b 

¥,{Zn<e^"-"';Z,>b,...,Zn>b) 



n 

< 6-^E[[](/;(l)/(e^i?,))^Zi > > b 

n 



Now we introduce the following random variable, only depending on the environment, 



Ma (6,3) := supE 

k>b 



where are i.i.d. random variables with (fixed) p.g.f. g. By the branching property, we may 
write a.s. 



MA(6,/0=supE[(e^^^) ^Zi+l>0 



k>b 

supE 

k>b 



; Zi+t > 



fiiZi — k 
fij Zi = k 



Then, by conditioning on the successive sizes of the population, we obtain 

< e^"-""; Zi > b, Zn > b) 



< b-^E 



< 



n (irw) ^ (Sj) '^n>b\ fn, Z, 
i=l 

n 

6-^E[[]MA(6,/i) 



;Zi >6,...,Z„_i >6 



i=l 

= r^E[MA(6,/)]". 

We now want to prove that for every a G (0,1), there exist A,6 > such that E[AfA(6, /)] < oi. 
Let g be fixed and deterministic. The idea is that for every 5, ^11^ ~^ ff'(l) as A; — >■ 00 

by the law of large numbers. We will be able to derive that 



E 



/ AT^N -A ^ 

V ka'd) J ' ^ 



<=i 



e 



as — > 00 and Mx{b, f) — > e~^'^ a.s. as b goes to infinity. Under suitable conditions, we are then 
able to prove that E[Mx{b, f)] — >• e"'^'^. Finally, considering A > such that e~^^ < e"" and b 
large enough gives us the result. 
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Let us now present the details of the proof. First we fix a p.g.f. g such that f;(0) < 1 and 
E[Nl] — g'{l) < oo. Then the law of large numbers ensures 



V fcg'(l) ) 



Moreover X]i=i -^f stochastically larger than a random variable B{k,g) with binomial distribu- 
tion of parameters (fc, 1 — g(0)). Applying the classical large deviations upper bound for Bernoulli 
random variables (see e.g. [TT1[T2]) yields for a; > 

k 

v(Yk > ^ TVf > o) < V{B{k, g)<k x'^/^g' (1)6-") < exp { - k i^gix'^/^g' (1)6-")) , 

where the function ipg{z) is zero if z > 1 — g{0) and positive for < z < 1 — g{0). It is specified 
by the Fenchel Legendre transform of a Bernoulli distribution, i.e. for < z < 1 — g{0), 

^Pg{z) = zlog (^) + (1 - z)log (ig). 

Moreover {Y!1=i A^f > 0} C {Yfe < k^d} with d = (^'(l) 



Thus 



E 



ifc]ln>.;^A^f > O] < dk^v{Yk > x-Y^Nf > O) < dfc^exp(-fcVg(2:-'/V(l)e""))- 

i=l i=l 

Let us choose x large enough such that tpgi^^'^^^g' i^)^^^) > 0. Then letting k ^ oo, the right- 
hand side of the above equation converges to 0. Moreover, we can apply the bounded convergence 
theorem to Yk'^Yk<x.Y,''-iN<?>o get 

fc 

limsup (n:ly.<i;,i:Li N!>o) 



limsupE[Yfc;Xl^f > 



= E 



< e 



Recalling that Mx(b,g) decreases with respect to b, we get for every g 



lim Ah{b,g) < e 

6— ^oo 



-Ae 



Second, we apply the bounded convergence theorem again and finish the proof by integrating the 
previous result with respect to the environment. To check that 

E[A/a(1,/)] <(X3, 

we define for any p.g.f g with 17(0) < 1 and g'{l-) < 00 the real numbers 



2.9'(1) 



yg := (fce-V(l))^ 



We note that x > Xg implies that a;"i/^5'(l)e"'^ < (1 - 5(0))/2. Moreover, J2i=i > implies 
Yk < Ug, and thus 



E 



[n;^iVf >0 



1 



<Xg+ cxp{- kipg{x~'^^^g'{l)e~''))dx 



<Xg+dk^eXp{- kljjg ( ^^^) ) . 
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Now we maximize the right-hand side with respect to fc > 1. Using that for all a > 0, a; > 0, 
^Ag-aa; ^ [X/a)'^e^^ and recalling that d — (g'(l)e^^)^, we get 

fc 



M;,(l,g)=supE[n;ViVf > 
fc>i '- ~T 



<x, + (e-V(l))'A^e-%(i^)- 



(4.2) 



Finally, we observe that ^g{z) is a nonnegative convex function which reaches in 1 — g(0). Thus 
3; < 2/ < 1 — ff(0) implies ipgix) > {x — y)'il}g{y) and in particular 



As ipg{z) — log( (]T:i)fi~^(o))) ^i^"^ log(l — x) < X for x > 0, we get that 



^.(i^)>~i^log(l ^ 



^ 3 1-g(0) ^ 3(1 -g(0)) 



3+ff(o)/ - 43 + g(0) 
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(4.3) 



Combining the inequalities H/2h and (4.3) yields 



MxilJ) < l + a(e,A) 



f(l) V 
1-/(0)^ 



a.s., 



where a(e, A) is a finite constant, only depending on e and A. Thus Assumption |2] ensures that 
E[Ma(1,/)] < oo. Adding that Mx{bJ) < Mx{lJ) a.s. for 6 > 1, we apply the bounded 
convergence theorem to obtain 



hm^ E [Ah (fo, /)] - E [ l\m^ Ah (&,/)]< 



6— voo 

Then, choosing b large enough, 

E[Ah{bJ)] <2e-^' 
Letting A such that 2e^'*'^ < e"" ends up the proof. 
Lemma 4.3. Let z > 1 and assume that 

g, = - lim MogP^(l <Zn<b) 

n— ^oo 

exists and does not depend on b large enough. Then, under Assumption^^ for every 9 G (0,E[X]] 

limsup i logP^l < Z„ < exp(n0)) < -xi^: A)- 
Proof. We define the last moment when the process is below b before time n : 
CTf, = inf{i < n : ^i+i > b, ■ ■ ■ , Z„ > 6}, (inf = oo). 
Let 9 > 0. Then summing over i leads to 
P.(l<^„<e«") 

n-l 

1=0 
n-l 

< y P^(l < Z, < b) supP,(l < Z„_,_i < e''", Zi > fe, Z„_,_i >b)+ P(l < Z„ < b) 

n-l 

< P(l < Z„ < 6) + y P.(l < Z, < b) [p(5„-.-i <en + ne) 



□ 



i=0 



+ supPj(Z„_,_i < e''", S-n-.-i > en + ne,Zi > 6,...,Z„_,_i > 6) 
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For the first factor, by assumption, we have for every t e [0, 1], 

lim ilogP,(l < ZLt„j <b) = -tg,. 

For the second factor, we use the classical large deviation inequality for the random walk 5* to get 
for every t e [0, 1] that 

limsup i logP(5L(i-t)«J < + = -(1 - tMj^t)- 



with the convention O-oo = 0. For the last probability, we apply Lemma [4.2[ which prevents a large 
population form deviating from the random environment. More precisely, for every e > 0, we can 
choose b large enough such that sup^-^^ Pj(Z„_i_i < e^", Sn-i-i > 6n+ne, Z\ > b, Zn-i-i > b) 
decreases faster than eicp[^pz[n — i — 1]) as n goes to infinity. Thus, for b large enough and every 

[0,1], 

limsup i log sup Pj(Z„(i_t) < e^", S'„(i^t) > 9n + ne,Zi > 6, Z„(i_i) > &) < -~g,{l~t). 

n— foo j>b 

Combining these upper bounds yields 

limsup i logP,(l < Z„ < exp(n0)) < - min { inf {tg, + (1 - t)A(f±f )}; g,} 

n— voo t^[0,l) 

Letting e — )■ 0, by right-continuity of A, the right-hand side goes to 

^ mf^^ {tfe + (1 - i)A(^)} = x{0,g.,A), 
with the convention • oo = 0. It completes the proof. □ 



4.3 Proof of the upper bound for Theorem 3.2 



We assume here that subcritical environments occur with a positive probability. First, we consider 
the probability of having less than exponentially many individuals in generation n and prove that 
the decrease of this probability is still given by g. We derive the upper bound of the second part 



of the theorem using Assumption 3.1 and an additional lemma 



Lemma 4.4. IfV{X < 0) > 0, then for every z e Cl(I), 

e = lim i logP^(Z„ - z) = lim liminf i logP,(l < Z„ < e« 
= lim limsup ^ logP;,(l < Z„ < e"") . 

^"^■0 n— ^oo 



Proof. The first identity is given by Proposition 2.1 (ii) and we focus on the second one. We 
observe that Vzi^ < Zn < e^") decreases as 9 decreases. As for every 9 > 0, Pz{Zn — z) < ¥^{1 < 
Zn < e^") for n large enough, we have 

p = lim i logP,(Z„ = z) < lim liminf i logP,(l < Z„ < e«"). 

n— ^cxD ^—^0 n— foo 

Let us prove the converse inequality. First, we observe that rriq < 1 — e implies q{0) > e. Using 
that P(mQ < 1) > by assumption and z E I, we choose e > and ji > 1 such that the sets 

A:^{qeA: q{0) > e, q{z) > e}, 6 {g £ A : m, < 1 - e, q{ji) > e} 
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satisfy 

}ieA)> 0, ViQi e S) > 0, Bc{qeA: g(0) > e, > e}. 



By Markov property, for every 9 > 0, 

P.(^„+Lf„j = ^) > E ^-(^" = fc)Pfe(^Lf«J = ^) 
fe=l 

> P.(l < ^„ < e'") min Pfc(Z| i„| = z) 

>Pz{l<Zn<e<'") min E[Pfe(Z|«„| - z|f ); Qi, . . . , Q, ^ G 6, Q, «„, G ^] 
>P.(l<^«<e'")x 

^^imn^E[Pfc_i(ZL|„j_i=0|£)Pi(ZL,„j = z|£); Qi, . . . , „j £^,^[1"] ^ ' (4-4) 
Using again the Markov property and the definition of B and A, we estimate a.s. 

Pi(^Lf«J =^IQi,---,Ql|"J-i ^^'QLf"J ^-^) 

> Pi(Zi = jilQi e 6) • P,,(Zi = jilQi e 6)Lf"J-2 . p^.^(Zi = z|gi e A) 

> e . eJi(Lf»J-2) . ^ji ^ £ji(Lf«J-i)+i ^ 

Using the classical estimates Pi(2'„ > 0\£) < exp(L„) a.s., where 

Ln ■■= min S'fc, (4.5) 

0<fc<n 

and log(l — a;) < —x, x £ [0, 1) yields for every fc, rt g N 

P,(ZLi„j = 0|Qi e 6, . . . , Q„ e > (1 - eL?"J i^sd--))''^ > (i _ g-Lf «J-)''^ a.s. 



Inserting the two last inequalities into (4.4), we get that 

> ^^^n^„ {(1 - e--Lf «-iJ)'=e^i(Lf «J-i)+ip(Q^ ^s,... , Ql|„J-i ^ 6, QLfnJ ^ ^)} 

> (1 - e-^"+°(i))"''"eJi(Ll"J-i)+ip(Q e 6)L?"J-ip(Q e A). 

Taking the logarithm and using the fact that (1 — 1/x)^ is increasing for a; > 1 and bounded 

il + e/e)g= hm i logP,(Z„+Li„j = ^) 

> limsup i logP^(l < ^„ < e^") + loge + f logP(Q € S) . (4.6) 

Thus, letting 9^0, 

g > lim limsup ^ logP^(l < Z„ < e^"), 

>0 n— i-oo 

which gives the expected converse inequality. □ 
Lemma 4.5. Under Assumption^ for every b > 0, n £ N and r e (0, 1), it holds that 

Pb(Z„ <r e^"|£) < (1- (l-r)2e^"/(" + 2))^ a.s. 
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Proof. Note that E[Zn{Zn — i)\£] ~ /on(l) Let us now check briefly that the resuh of 

Proposition 1 in [10 still holds, which means that we can replace Assumption 2 in |10j by our 
Assumption [3j From /o,„ = /o,n-i ° fn, by chain rule for differentiation /o,„(l) = /o,„-i(l)/4(l) 
and /^;„(1) = /^',„_i(l)/;(l)2 + /^,„_i(l)/;r(l), we get that 



Using Assumption |3] yields 



fi>,n-ia).fkar 

By iterating this inequality, we have a.s. 

E[z„(z„-i)|n] _ fdji) 



< 2d^e-^'' a.s. 



Finally we get for every n e N, 

n 

Ei[Z„(Z„ - 1)|£] < 2de2^" ^ e"'^" < 2d {n + l)e^"e'^"--^" a.s. 

/c=0 

Combining this inequality with an inequality due to Paley and Zygmund, which ensures that 
for any [0,oo) valued random variable ^ such that < E[^] < oo and < r < 1, we have 
> rE[^]) > (1 - r)2E[^]VEK^] (see Lemma 4.1 in 20 ). Then a.s., 

P.(Z„>.e-|.)>(l-.)^M 

^ (n+l)e^"e^^"-^"+eS" n + 2 

Given £ and starting with Zq — 6, 5-many subtrees are developing independently. Each has the 
above probability of being larger than re^" . Thus 

<{^-{^~rf^f a.s., 
which is the claim of the lemma. □ 
Lemma 4.6. IfV{X < 0) > and Assumption^holds, then for all z e Cl{I), 9 e (0,E[X]], 
limsupilogP^(l < Z„ < exp(n6l)) < -x{0,Q,K). 

n— foo 

Proof. Let z E Cl{T). For the proof of the upper bound, we will decompose the probability at the 
first moment when there are at least n'^-many individuals for the rest of time. For this, let 

tT„ := inf{l < i < n : Zj > , j ~ i,. . . ,n}, (inf := n) 

and 

T„ := inf {O < i < n : S'i < min{S'o, Si, . . . , 5„}} . 
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Let us fix < 6* < E[X]. Then by Markov property, 

n 

P.(l <Zn< e'^) - ^P.((T„ = ^, 1 < Z„ < e'^") 

i=l 

n 

< VP;,(1 < < n^) maxPfe(l < Z„_i < e^", VI < j < n - i : Z^- > n^) 

n n—i 

= VP.(1 < ^,-1 < V maxPfe(l < Z„_, < e«";T„_, = j, VI < j < n - i : > n^) 

71 n—i 

< V P.(l < ^,-1 < V P(r, j) niaxPfc(l < Z„-^-J < e""; L„_,_, > 0). (4.7) 

^ — ^ — ^ k>n'^ 
1=1 j=0 



Next, we treat the different probabilities separately. First, by Lemma 4.4 for all t, s G (0, 1) with 
s + t < 1 , we have 

limsup i logP(l < ZL(i_t_s)«j-i < 11^) = -(1 - t - s)p. 

n— >-oo 

As to the second probabifity, as P(r^i — n) < ¥{Sn ^ 0), 

hm ilogP(rL,„j = Ls"J)<-sA(0). 

Next, for every e > 0, 

min Pfc(l < ZLt„j < e''";LLt„j > 0) 

< min E[Pfe(l < Z^tni < e«"|£);5Lt"j > {9 + e)n, L^t,,^ > O] + P(5'Lt„j < {9 + e)n). 



Using Lemma |4.5[ for n large enough, 

E[Pfc(l < ZLt„j < e«"|f); > {e + e)n,L^t^i > O] 



max 



< maxE[Pfc(l < Z„ < e-^"e^L-J jf); 5Lt„j > (0 + LLt„j > O] 

< max (1 - (1 - e-^")2p;^) V(LLt„j > 0, S^^^^ > {9 + e)n) 



k>n^ 

3 

^" 

[tnj +2 



<(l-(i-^)^n;i^r 



Then, for every t > 0, 

limsupilogmaxE[Pfe(l < Z^tn] < e''"|£); V^j > {9 + e)n,L^t^i > O] 

n— i-oo k>n^ 

< lim sup log (l - i jj:;^) = -oo. 

Tl— >00 

Finally, recall that 

lim ilogP(5Lt"J < + = -tA{{9 + e)/t) . 



Applying all this in (4.7 1 and letting e — >■ yields the upper bound, i.e. 

limsup i logP(l < Z„ < e"^) < - inf {(I - s - t)p + .sA(0) + tA( (9 + e)/t)] 

n-i-oo " s,te[0,l];s+t<l 

= - inf {(1 - t)p + tA{9/t+)} = x{0, 9, A). 
te[o,i] 

In the last step, we used that Proposition 2 in [S] guarantees A(0) > p under Assumption |3j 
together with A(0) > A(x) for every x > and right-continuity of A. □ 
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4.4 Proof of Theorems |3TT] and [3721 



Proof of Theorem 3.1 (i). Let z > \. The second part of Proposition 2.1 ensures that for b large 
enough, 

e = - hm ilogP,(l < Z„ < 6). 

n— >-oo 

Then, under Assumption [2j Lemmas |4.1| and |4.3| yield 
The right-continuity of x(^^, Q,^) proves the last part of the result. 



lim MogP(l < Z„ < e 

n— foo 



□ 



Proof of Theorem 3.1 (ii). We recall that the monotonicity of Z (see also [7]) ensures that for 
every b > z 

lim ilogP,(l < Z„ < 6) = zlogE[Q(l)]. 

n— j-oo 

Then, under Assumption [2] and E[Zi log^(2'i)] < 00, Lemmas 4.1 and |4.3| yield 

hm MogP,(l < Z„ < e"^) = -x(0,-zlogE[Q(l)],A). 
The right-continuity of A) proves the last part of the result. □ 



Proof of TheoremlSTM The first part is a direct consequence of Lemma 4.4 



As we assume P{X < 0) > 0, we can use again the second part of Proposition 2.1 which ensures 
that for b large enough, 

g = - lim ilogP,(l < Z„ < 6). 

n— )-oo 

Then, under Assumption [s] and E[Zi log'^(Zi)] < oo, we can combine Lemmas 

hm ilogP,(l < Z„ < e"") = ~xiO,Q,A) 



4.1 



and 



4.6 



to get 



for every z > 1. It completes the proof. □ 
4.5 The linear fractional case 

In this section, we restrict ourselves to the case of offspring distributions with generating function 
of linear fractional form, i.e. 



m-i +6 m-2(l - s)/2 ' 



where m = /'(I) and b = /"(I). 



Proof of Corollary \3.3\ Recall that s — >■ E[e'' ] is the moment generating function of X, which 



is a convex function. The result of the corollary is trivial if p = ^(0)- Thus, using 2.3 



we 



can focus on the case p = E[e and < E[Xe < oo. Then E[e < oo and we have 
g = -logE[e"^] < sup^<o{-loglE[e^'^]} = A(0). Note that A(0) = oo is possible. 
Let us recall some details of Legendre transforms. It is well-known (see e.g. [12] ) that 

ve{s) := -e's-logE[e-"-^] 



18 



is a convex function. The conditions E[e < oo and < E[Xe ^] < oo imply by the dominated 
convergence theorem that v above is differentiable in s = 1 and 

■■= -0 -E[Xe-^]/E[e~^] . 

Thus by definition of 9*, the derivative of Vg, vanishes for s = 1, i.e. Vg takes its minimum in 
s = 1. Thus, 

A{9*) -9* - logE[e~^] < oo 

and by the theory of Legendre transforms, the tangent t on the graph of A in 9* is described by 

t{9) := -6l-logE[e--^] . 

As A is convex and decreasing for 9 < E[X], we have A{9) > t{9) for 9 < 9* . This proves the 
representation in Corollary |3.3[ □ 
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